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INTERACTIVE SMART TAPn SYSTKM FOR INTEORATINr; 
THE PROVISION OF REMfYTF AM Q LOrAI. WPVirF^ 



Field of the Invgntion 

The present invention relates to portable information and communication systems, 
and more particularly, to communication between a hand held portable electronic device 
and various local and ronote services. 

Art BflckPfftund 

Consumers today are confronted with a bewildering variety of goods and services 
such as cable television, financial transactions and home shopping catalogues. Currendy. 
consumers must separately access each distinct service. For example, to order a pay-per 
view movie currently requires contacting a cable television operator through one device, 
often a telephone, and contacting a bank through a different device, an automatic teller 
machine or a computer. There are many other examples of the splintering of goods and 
services amongst different devices, which causes consumer confusion and inefficiency. 

Apart from the difficulties from the consumer's standpoint, present technology 
does not provide for efficient data gathering and similar fiinaions. For example, present 
opinion polls are typically conducted by telqihone, which is expensive and time 
consuming, which may deter persons from participating in the poll. Odier dau gathering 
operations suffer from similar flaws. 

Present information technology has further limitations. Despite an existing 
infrastructure of cable television channels, the television industry has yet to provide 
consumers with the type of interactivity becoming increasing popular in multimedia 
applications. There is thus a need for a device Uiat allows existing communication 
infrastructures to provide real time interactivity for television. 

As will be described, the present invention solves the disparate problems presented 
by current technology by integrating a wide variety of interfaces to goods, services and 
other information providers within a hand held, portable device. The present invention 
achieves real time interactivity for television networks or other sources and is convenient 
for consumers. These and other advantages of the presem invention will be apparent from 
the following description. 
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S ^ ^mmflrv of \H lnv«it'on 

The present invention includes methods and apparatus for wcreasing the efficiency 
of remote service transactions. According to the present invention, a smart card includes 
a light sensor for receiving data from a display, such as for example a television, wherein 
the data is encoded in the spectrum of light provided by the display. The light sensor is 
coupled to a central processing unit (CPU) and a random access memory (RAM). The 
CPU and RAM and a read only memory (ROM) are coupled to a modem. 

In operation, the smart card receives information associated with a remote service 
provider from light emitted from the television display and receives input from a user. 
Based upon the the information received ifirom the television and the user's input, the 
modem is provided with a telephone number to carry out an automated transaction with 
the remote service provider. To maintain system security, data that is provided to the 
card may be encrypted. 

The present invention also includes specific applications of the smart card. These 
services include: remote financial services, near video-on-demand with automated order 
and billing, pay-per-view with automated order and billing, appointment TV, home 
shopping, real-time market studies and opinion polls and electronic gaming and 
sweq>stakes. 
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IN THE DRAWINGS! 

FIGURE 1 is a block diagram of the communication inteifaces b^een a smart 
card of the present invention and television and remote service providers. 

FIGURE 2 illustrates one possible interface between the smart card of the present 
5 invention and a service provider. 

FIGURE 3 illustrates one side of the smart card of the present invention. 

FIGURE 4 is a block diagram of the electronics disposed within the smart card of 
the present invention. 

FIGURE 5 illustrates an alternate embodiment of the smart card of the present 
10 invention. 

FIGURE 6a illustrates the smart card inserted into a VCR remote control. 
FIGURE 6b is a side view of the embodiment illustrated in Figure 6a. 
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pUKFERREP FMBODIMENT 

The present invention discloses apparatus and methods for providing various 
services to a consumer through the use of a smart card. In the following description, 
numerous specific details are set forth such as the shape of the smart card and various 
interfaces in order to provide a thorough understanding of the present invention. 
However, it will be apparent to one skilled in the art that the present invention may be 
practiced without these specific detoils. In other instances, well known circuits, structures 
and the like are not described in detail so as not to obscure the present invention 
unnecessarily. 

System Overview 

Fif^re 1 illustrates communication interfaces to a smart card 10 of the present 
Invention. As illustrated in the figure, the smart card 10, which includes a modem as will 
be described more fiilly below, communicates with a remote service 16 over a two way 
communication medium such as a telephone line. The remote service 16 may comprise 
any type of service that supports digital communication and specific remote services will 
be described more fiilly below. 

In addition to the two way communication link between the smart card 10 and the 
remote service 16, the smart card 10 is capable of receiving information from light 14 
emitted through a television screen 13 where the information has been encoded through a 
VEIL protocol onto the signal 12 provided by a head end 15. The VEIL interface is 
described more ftilly in the copending application, PCT/US95/00759, entitled 
TELEVISION SIGNAL ACTIVATED INTERACTIVE SMART CARD and incorporated 
herein by reference. The combination of interfaces with the head end 15 and the remote 
service provider 16 results in greatly enhanced functionality, as will be described more 
fiilly below. 

Figure 2 illustrates one possible interfoce between the smart card 10 and the 
service provider 16. As shown, the smart card 10 is coupled to a telephone line by a 
standard RJll telephone jack 18 or cellular phone data port through a cord assembly 20. 
In turn, the cord assembly 20 is coupled to the smart card 10 by a PCMCIA style mini- 
connector 22. In an alternate embodiment, the smart card 10 may be coupled to the cord 
assembly 20 by a slip-on slide conneaor on the smart card 10. As will be appreciated, 
there are many other mechanisms for coupling the smart card 10 to a telephone line 10. 
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In yet another alternate embodiment, the smart card 10 contains a wireless interfece (not 
shown) that supports wireless telephony through either a satellite oi other communications 
system such as a cellular network. 

Figure 3 illustrates one side of the smart card 10. As shown, the card includes 
5 optics 24 for receiving light from a display, an ISO 7816 interface 26, a hologram 28, 

buttons 30 and 32 and an LCD Screen 34. The smart card 10 displays various menus on 
the LCD Screen 34 and a user of the smart card 10 may select menu options and provide 
other input to the smart card 10 through the buttons 30 and 32. Many other types of user 
interfaces are possible. 

10 As will be described more fiilly below, the ISO 7816 interface 26 allows the smart 

card 10 to be used in conjunction with other devices. As one example, the smart card 
may be used as a card for an automatic teller machine that is compatible with the ISO 
7816 interface 26. 

Figure 4 is a block diagram of the electronics disposed within the smart card 10. 

15 Data from external sources is converted into digital data. Thus, as illustrated, a modem 
42 and the ISO 7816 interfece 26 are coupled to a multiplexer 46, which provides serial 
data to a universal asynchronous receiver-transmitter (UART) 47. In a preferred 
embodiment, the modem 42 is compatible with a standard modem protocol such as Bell 
300, and supports auto-dial. The UART 47 in turn provides parallel data to a bus 72, 

20 which is coupled to a central processing unit (CPU) 48 and a static random access 

memory 52. A VEIL receiver 40 that is coupled to the bus 72. A transceiver 74 coupled 
to die bus 72 converts electromagnetic waves of lower frequency than visible light 
received over antenna 76 into digital data. 

The external-data is provided to the SRAM 52 where it is processed by the CPU 
25 48 according to program in the ROM 50 and EEPROM 54. A button subsystem 62 is 
coupled to the buttons 30 and 32 and allows the user to make selections based upon the 
external data and provide other input to the smart card 10. Information is provided to the 
user by the LCD 34 that is coupled to an LCD driver 58 that is in turn coupled to an 
LCD frame buffer 60 that is coupled to the bus 72. 
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Still referring to Figure 4, the smart card 10 includes a power subsystem 70 to 
provide power to the electronic components. According to one en»bodiment, the power 
subsystem 70 includes a non-rechargeable power source and in an alternate embodiment, 
the power subsystem 70 includes a combination of a non-rechargeable and rechargeable 
power sources and a solar panel in conjunction with power supply logic. Still referring to 
Figure 4, an oscillator 66 and clock 64 to maintain the appropriate time. 

Figure 5 illustrates an alternate embodiment of the sman card of the present 
invention. An electronic sleeve 80 deflnes a slot 82 for receiving a smart card 84 and the 
electronic sleeve 80 conuins a battery 86, optics for receiving light from a display and a 
user interface including LCD 90 and buttons 92 and 94. Since these components reside 
within the electronic sleeve 80, the smart card 84 illustrated in the figure need not contain 
these components. The smart card 84 interfaces with the electronic sleeve 80 through an 
ISO 7816 conuct 98 as illustrated. 

VEIL Encoding 

As previously described, the smart card 10 receives light from the television 
display 13 where the light has been encoded within a broadcast program. According to 
the present invention, the VEIL data may be transmitted according to any type of packet 
protocol. I a preferred embodiment, the packet protocol comprises packets with five 
fields in each packet. The fields include a general purpose packet identification field, an 
owner identification field, an encrypted authorization key, a packet identification field and 
packet data. The packet identification field provides information regarding the type of 
data in the data field. For example, the packet identification field may indicate that the 
data is related to coupons, frequent flier miles or movie schedules. The packet 
identification field may also be used to define "generic** classes of opportunities, which 
can serve to limit the amount of explanative information to be transmitted. 

According to the present invention, the VEIL data may be encrypted. Preferred 
data encryption methods include DES and RSA based public key encoding, and more 
specifically, RC5 type encoding. Also, the VEIL data may be compressed and error 
detection and correction applied according to Hamming or Goppa codes. 

As described in the copending application entitled "COM-CARD% filed January 
19, 1994, Serial Number 08/183,525, the smart card 10 is capable of receiving coupons in 
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the form of UPC codes. The bar code contains manufacturer identification, family code 
and value code data that may be used for most coupons. The manufacturer identification 
and family code contain manufacturer specific data that may be stored in the ROM 50 for 
a subset of manufacturers. This data may then be used to automatically extract the 
manufacturer name, product name and size from the bar code data. The value code is 
universal and may be used to extract the coupon redemption value. 

Applicatioas 

The apparatus illustrated in Fif^ures 1-5 has a variety of applications, including but 
not limited to: remote financial services, secure and automated payment medium, near 
video-on-demand with automated order and billing, pay-per-view with automated order 
and billing, appointment TV, home shopping, retail services, catalogues, travel services, 
etc, real-time market studies and opinion polls and electronic gaming and sweepstakes. 
This Specification will now describe these applications. 

Financial S ervices Annlicatinn 

The smart card 10 is capable of performing a variety of financial services 
^plications. When the smart card 10 is issued to a particular user, the EEPROM 
memory 54 within the smart card 10 stores multiple account information for remote 
financial services. The multiple account information includes: financial institution(s) 
access information, account number(s), account type(s) and transaction type(s). According 
to the present invention, a plurality of accounts for a plurality of financial institutions may 
be stored on one card. Further, the financial and account information may be 
automatically updated or modified through the telephone interface illustrated in Figures 1 
and 4. 

The user initiates a financial transaction by providing input to the smart card 10 
through the buttons 30 and 32 as Ulustrated in Figure 3. The user requests a specific, 
financial transaction such as a balance inquiry by selecting an appropriate graphical icon 
on the LCD 34. Once the transaction has been selected, the LCD 34 prompts the user to 
press a button 30 to carry out the transaction. Additionally, die smart card 10 may - 
prompt the user with an audible tone. 

After receiving die request fix)m the user, prestored information in the ROM 50 or 
EEPROM 54 and a predefined messaging protocol are provided to the modem 42 or die 
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wireless interface which automatically contact, through the appropriae medium, the 
financial institution. The smart card 10 and financial institution then exchange data to 
carry out a fully automated transaction. When the transaction is complete, the smart card 
10 LCD 34 provides a summary of the transaction results. For enhanced security, a 
5 uansaction process may require the smart card 10 user to enter a PIN code, using the 

buttons 30 or 32 on the smart card 10, which will be authorized by the financial institution 
prior to carrying out the transaction. 

Near Video-Qn»Demand and P av-Pw^Vigw Application 

As previously described, the smart card 10 is optically coupled to the display 13 

10 of a television to receive information encoded with a television signal. A tdevision 
service provider may thus provide over a television channel information related to 
programs and movies available on a pay-per view or on-demand basis. As described in 
the related application PCT/US95/00759 entitled TELEVISION SIGNAL ACTIVATED 
INTERACTIVE SMART CARD, the user may then download this information through 

15 the VEIL interface. Once this information has been transferred to the sman card 10 , the 
user may select from the available programming using the graphical menu-driven interface 
on the LCD 34. The user then selects the physical location where the programming is to 
be provided. Such physical locations may include any location corresponding to account 
address(es) stored in the smart card 10 or the location corresponding to the phone number 

20 used to place the order. 

After selection occurs, the modem 42, or the wireless interface automatically 
contact the appropriate service provider and the transaction is automatically completed, 
including debiting the account of the user, through a predefined messaging protocol. The 
telephone numbers for service providers may be stored in the smart card 10 based upon 
25 the channel over which the information is received. Alternatively, the telephone number 
of the service providers may be provided within this information. 

Once the transaction has been authorized, information related to the program time 
and channel will be sent to the smart card 10 and displayed on the LCD 34 for the us^. 
As previously described, security can be enhanced by requiring the user to enter a PIN 
30 code, using the buttons 30 or 32 on the smart card 10. which will be authorized by the 
near video on demand or pay per view system prior to activating the program seleaion. 
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Appointment and Coupon Television 

The interfaces illustrated in Figure 1 may also be used to provide other services 
such as "virtual shopping/ fuiancial services, entertainment programming and educational 
programming. 

"Virtual shopping** includes a variety of applications. For example, the television 
display 13 may show a guided tour through a supermarket pointing out key nationally 
advertised items. Each of these items can be introduced and presented by a product 
spokesperson and followed with a commercial including a paperless coupon that may be 
provided to the user through the VEIL interface. For a description of the use of a smart 
card 10 in conjunction with coupons, see the related application PCT/US95/00759 entided 
TELEVISION SIGNAL ACTIVATED INTERACTIVE SMART CARD. 

The present invention also provides tor appointment television. A catalogue of 
programming may be displayed on a television and the user may download this catalogue 
using the VEIL interface of the smart card 10 and select which program to view. Once a 
program is seleaed, the LCD 34 will prompt the user to enable the modem 42 or wireless 
interface to automatically contact the proper television network. The program will be 
broadcast at the proper time and the smart card 10 may be programmed to remind the user 
with an audio tone and visual display at predetermined times before die program is 
initiated. 

In addition to appointment television, the smart card 10 may remind the user of 
advertising/promotional, fmancial, and programming incentives. 

Home Sho pping Application 

The smart card 10 of the present invention may be used in conjunction witfi home 
shopping. A home shopping network may broadcast an item for sale and information 
regarding that item may be downloaded through the VEIL interface as illustrated in the 
figures. The information regarding die item may include: home shopping program access 
information, item name, item description, item price and item commercial and 
programming rerun times. 

If the user is interested in purchasing die item, he or she may dien download item 
information into die smart card 10 dirough die VEIL interface. The LCD 34 dien displays 
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the item Information and the user is prompted to choose whether he or she intends to 
purchase the item. If the user decides to purchase the item, the LCD 34 prompts the user 
to enable the modem 42 or wireless interface. The smart card 10 then uses the access 
information to automatically dial a home shopping program automated service computer to 
place the order using a predefined messaging protocol. Billing is automatically directed to 
the user's account using the card holder's billing address for shipping. 

After the transaction is complete, information regarding the status of the order 
may be displayed on the LCD 34, including the cost and shipping time. To provide 
additional security, a transaction process may require the user to enter a PIN code, using 
the buttons 30 or 32 on the smart card 10, which will be authorized prior to carrying out 
the transaction. 

p^TA FATHERING APPLICATIONS 

The present invention as illustrated in Fijjures 1 - 5 may be used to efficiently 
gadier data. A market study or opinion poll questionnaire may be broadcast over the 
television through the VHL Interface as illustrated in Figure I. The poll or study may be 
ddivered to selected regions or on a national basis. As an example of this application, the 
cani user v«ll be presented with a list of questions on the LCD 34 or television display 13 
and requested to select an answer. The smart card 10 will then prompt the card holder to 
enable the modem 42 or wireless imerface which automatically connects with a remote 
computer system. 

The card holder's response to the questionnaire will then be automatically 
transferred to the remote computer system through the modem 42 or the wireless 
interfece. In addition to the card holder's response, information related to the card holder 
can be transferred to the remote computer system. This information can include, for 
example, the card holder's age, sex, geogr^hical location or other demographic data. 
The serial number stored in the smart card 10 can be used to eliminate multiple responses 
from a single card holder. 

y!ntipon Encoding 

The smart card 10 of the present invention may also be used to gather information 
at a poim of sale. As described in the related application PCTAJS95/00759 entitied 
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TELEVISION SIGNAL ACTIVATED INTERACTIVE SMART CARD, the smart card 
10 of the present invention may receive a coupon over the VEIL interface and the coupon 
may be redeemed at a point of sale by scanning the UPC code related to the coupon. The 
UPC code is displayed on the LCD 34. 

In addition to distributing coupons, manufacturers and other persons have a need 
to gather data related to coupon redemption. Currently, such information is typically 
gathered through coupon clearing houses, which have questionable security and are 
relatively inefficient. The smart card 10 provides an efficient and secure alternative to 
clearinghouses. Confidential data regarding the card holder is encoded within the 
extended fields of a UPC code. In order to prevent unauthorized use of the confidential 
data by third party retailers, clearinghouses, and redemption centers, this information is 
encrypted. 



The following fields are defined in the extended UPC code: 

1) NSC Code; 

2) One digit manufacturer's number system character; 

3) Offer Code: five digit element; 

4) Coupon expiration date: four digit month/year of coupon expiration; and 

5) Household identification: eight digit element. 

In a preferred embodiment, the five digit offer code and eight digit household 
identification include encrypted confidential and proprietary measurement data. This 
provides a minimum of 13 decimal digits or the equivalent of 43 bits of measurement 
data. Data will be encrypted using a DES-type encryption technique and then dynamically 
displayed on the LCD 34 for coupon redemption. The exact information that wUl be 
conveyed at the point of sale may be determined on the basis of the type of coupon which 
includes, without limitation, the following types of data relevant to the card bolder: age, 
sex, demographic data and psychogrjqjhic data. The dau may then be analyzed by a party 
who has obtained the proper decryption key. 



In addition, the source of the coupon, for example the television program the 
coupon was encoded onto, can be dynamically added to the bar code data before 
redemption for providing this measurement data when the coupon is redeemed. 
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Vf-R Apnliciitions 

The smart card 10 may be used to program video cassette recorders (VCR's). 
.Date and time information for a program may be provided through the VEIL interface and 
a promotion for the show simultaneously broadcast to the user. If the user wishes to tape 
5 the show, the user may download the program information by depressing an appropriate 
key 30 or 32 on the smart card 10. 

Once the program information is stored in the smart card 10, it may be provided 
to a VCR. Figure 6a illustrates the smart card 10 inserted into a VCR remote control 100 
with a slot for receiving the smart card 10 and Figure 6b is a side view of the 
10 embodiment illustrated in Figure fa. The smart card 10 provides the program 

information to the VCR through the VCR remote control 100. Using a standard infrared 
interface, the VCR is automatically programmed, without viewer input or use of the 
television picture for displaying menus. 

Rgfll-Time Interactive Applicatiom 
15 It will be appreciated that the interfaces illustrated in Figure 1 support real time 

interactive applications. For example, a game show may be displayed over the television 
display 13 and information related to the show downloaded into the smart card 10. A 
viewer may play the game by providing input to the smart card 10 which then dials the 
appropriate numbers to provide the user*s input to a game server. 

20 Although the present invention has been described in terms of a preferred 

embodiment and with reference to Figures l-6b, it will be appreciated that various 
modifications and alterations might be made by those skilled in the art without departing 
from the spirit and scope of the invention. For example, instead of receiving li^t from a 
television display, the smart card may be optically coupled to a computer screen for 

25 receiving data over a computer network. Many other alternatives are possible. The 
invention should therefore be measured in terms of the claims which follow. 
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Claims 



1. An apparatus for providing remote services; comprising: 

a light sensor for receiving data from a display, said data encoded within light 
from said display; 

a central processing unit (CPU); 

a memory coupled to said CPU and said light sensor for storing said data; and 
a modem coupled to said CPU for communicating with a remote service providi 

2. The apparatus of daim 1 wherein said apparatus is comprises a unitary device. 

3. The apparatus of claim 2 wherein said unitary device is substantially the same 
dimensions as a credit card. 



4. The apparatus of claim 1 further comprising an LCD display. 

5. The apparatus of claim 1 further comprising a plurality of buttons for providing 
input to said memory. 

6. A method for providing remote services comprising the steps of: 

providing digital data over a television channel, said data related to a transaaion 

source; 

receiving in an electronic device said digital data; 
extracting a telephone number from said digital data; 
providing said telephone number to a modem; and 
carrying out a transaction with said transaction source. 

7. The method of claim 6 wherein said electronic device comprises a smart card. 

8. The method of claim 7 wherein said step of providing said telephone number to a 
modem is operative after a user provides input to said smart card. 

9. The method of claim 6 wherein said transaction includes a debit to a user*s 
account and said method further comprises the step of automatically debiting said user^s 
account. 
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10. The method of claim 6 wherein said transaction relates to a pay per view 
television broadcast. 

1 1 . The method of claim 6 wherein said transaction relates to the purchase of an item 
from said transaction source. 

12. A method for programming a programmable device comprising the steps of: 



13. The method of claim 12 wherein said digital dau comprises date and time 
information for a television show and said programmable device comprises a video 
cassette recorder. 

14. A method for providing a signal to a person comprising the steps of: 
providing digital data over a television channel; 

receiving in an electronic device said digital data; and generating a signal at a time 
according to said digital data. 

15. The method of claim 14 wherein said digital data comprises date and time 
Information for a television show. 

16. The method of claim 14 wherein said electronic device comprises a smart card. 

17. The method of claim 14 wherein said signal comprises an audio signal. 



providing digital data over a television channel; 
receiving in an electronic device said digital data; 
transmitting said data to said programmable device; and 
progranuning said programmable device according to said data. 
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